Papers with conditional probing
Conditional probing: measuring usable information beyond a baseline (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for probing representations are limited to predicting part-of-speech . current methods cannot detect when a representation is predictive of just aspects of part- of-seech not explainable by the word identity. |
| Approach: | They propose to condition on the information in a baseline representation to test whether it is predictive of part-of-speech. |
| Outcome: | The proposed method is based on a theory of usable information called V-information and conditions on the information in the baseline. |